On Evaluation of the Mean Service Cycle Time 
in Tandem Queueing Systems* 

N. K. Krivulin tt V. B. Nevzorov §1 



Abstract 

The problem of exact evaluation of the mean service cycle time in 
tandem systems of single-server queues with both infinite and finite 
buffers is considered. It is assumed that the interarrival and service 
times of customers form sequences of independent and identically dis- 
tributed random variables with known mean values. We start with 
tandem queues with infinite buffers, and show that under the above 
assumptions, the mean cycle time exists. Furthermore, if the random 
variables which represent interarrival and service times have finite vari- 
ance, the mean cycle time can be calculated as the maximum out from 
the mean values of these variables. Finally, obtained results are ex- 
tended to evaluation of the mean cycle time in particular tandem sys- 
tems with finite buffers and blocking. 

Key- Words: tandem queueing systems, mean cycle time, recursive 
equations, independent random variables, bounds on the mean value 

1 Introduction 

We consider tandem systems of single-server queues with both infinite and 
finite buffers. The interarrival and service times of customers are assumed to 
form sequences of independent and identically distributed random variables. 
Given the mean values of interarrival and service times, we are interested 
in evaluating the mean cycle time of the system. In what follows, the mean 
cycle time is used in reference to the mean value of the time interval between 
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two successive departures of customers from the system as the number of 
customers tends to infinity. The inverse of the mean cycle time, which 
implies the mean number of customers leaving the system per unit time, is 
referred to as system throughput. 

Among other characteristics including, in particular, the mean waiting 
time of customers, both the mean cycle time and the throughput present 
system performance measures commonly used in the analysis of queues. 
Note that the problem of evaluating the mean waiting time is known as 
rather difficult; it allows for the exact solution in an explicit form only for 
particular queueing systems under certain restrictions on customer arrival 
and service processes. One can find an overview of related results in pQ (see, 
also, [2] for more recent results and references). 

In many cases, the mean cycle time can be calculated exactly under fairly 
general assumptions. As an illustration, one can consider results obtained 
in [31 H] in the context of investigation of stability of queueing systems. It 
has been shown in [2] that for a general single-server system with infinite 
buffer capacity, regardless of whether it is stable or not, the mean cycle time 
can be calculated as the maximum out from the mean values of customer 
interarrival and service times. Moreover, if a tandem system of queues 
with infinite buffers is stable, the intensities of both customer arrival and 
departure processes coincide, and therefore, the mean cycle time is equal to 
the mean interarrival time of customers. 

For more complicated queueing systems including tandem queues with 
finite buffers and blocking, and fork-join networks there are some techniques 
which allow one to derive bounds on the mean cycle time. Specifically, an 
efficient approach which relies on results of the theory of large deviations as 
well as on the Perron- Frobenius spectral theory has been proposed in 0(6]. 
As another example, one can consider simple bounds in 018], obtained by us- 
ing an approach essentially based on pure algebraic manipulations together 
with application of bounds on extreme values, derived in [TO]. 

In this paper, we first give quite general conditions for the mean cycle 
time in tandem queueing systems with infinite buffers to exist, and show how 
it can be calculated through the mean values of the interarrival and service 
times of customers. The obtained results are then extended to evaluation of 
the mean cycle time in particular tandem systems with finite buffers, which 
operate under the manufacturing and communication blocking rules. 

As the starting point, we take obvious recursive equations which describe 
tandem system dynamics, and then examine their related explicit solution. 
Our approach is based on simple algebraic manipulations with the solution, 
combined with some classical results providing bounds on the mean value of 
maxima of independent and identically distributed random variables. The 
approach does not involve taking account of stability of the entire system, 
and therefore, offers a unified way of examining both stable and unstable 
systems. 
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The rest of the paper is organized as follows. In Section [21 we introduce 
some notations, and consider recursive equations describing the dynamics of 
tandem queueing systems with infinite buffers. Section [3] presents prelimi- 
nary results including an existence theorem and some inequalities. Our main 
result which provides general existence conditions and a simple expression 
for calculating the mean cycle time is included in Section 01 The obtained 
results are then applied to the examination of the mean cycle time in par- 
ticular tandem systems with finite buffers in Section [5j Finally, Section [6] 
offers some concluding remarks and discussion. 

2 Tandem Queues with Infinite Buffers 

We consider a series of M single-server queues with infinite buffers and 
customers of a single class. Each customer that arrives into the system is 
initially placed in the buffer at the 1 st server and then has to pass through all 
the queues one after the other. Upon the completion of his service at server i , 
the customer is instantaneously transferred to queue i+l, i = 1, . . . ,M— 1, 
and occupies the {i + l) st server provided that it is free. If the customer 
finds this server busy, he is placed in its buffer and has to wait until the 
service of all his predecessors is completed. 

Denote the time between the arrivals of n th customer and his predecessor 
by TQ n , and the service time of the n th customer at server i by Tj n , i = 
1,...,M, n = 1,2,... . Furthermore, let Dq(ti) be the n th arrival epoch 
to the system, and Di(n) be the n th departure epoch from the i th server. 
We assume that for each i , i = 0, 1, . . . , M , the sequence {rj n | n = 1, 2, . . .} 
consists of nonnegative random variables (r.v.'s). 

With the condition that the tandem queueing system starts operating at 
time zero, and it is free of customers at the initial time, we put Z?i(0) = for 
all i = 0, . . . , M . The recursive equations representing the system dynamics 
can readily be written as 

D (n) = D (n - 1) +r 0n , 

D m {n) = max(£» m _i(n),L> m (n - 1)) +r mn , m = 1, ...,M, 

for all n = 1, 2, . . . . 

The above recursions can be resolved to get 



for all m = 1, . . . , M . 

We consider the evolution of the system as a sequence of service cycles: 
the 1 st cycle starts at the initial time, and it is terminated as soon as the 
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M server completes its 1 st service, the 2 cycle is terminated as soon 
as this server completes its 2 nd service, and so on. Clearly, the completion 
time of the n th cycle can be represented as Dm{ji). 

In many applications, one is interested in evaluating the mean service 
cycle time of the tandem system, which can also be treated as the mean 
interdeparture time of customers from the system. It is defined as 

7 = lim -D M {n) (2) 

n—too n 

provided that the above limit exists. The system throughput it presents 
another performance measure of interest, which is calculated as the inverse 
of the mean cycle time; that is, ir = I/7. 



3 Preliminary Results 

In order to examine the existence of the mean cycle time for the tandem 
queueing system, we will apply the next classical theorem which has been 
proved in [llj . 

Theorem 1. Let {(i n \ I, n = 0, 1, . . . ; I < n} be a family of r.v. 's which 
satisfy the following properties: 

Subadditivity: Q n < Qk + Cfcn for all I < k < n ; 

Stationarity: the joint distributions are the same for both families {Cin\ I < 
n} and {Cz+i,n+l| I < n} ; 

Boundedness: for all n = 1,2,..., there exists E[£on] > —cn for some 
positive constant c. 

Then there exists a constant 7, such that it holds 

1. lim Con/n = 7 with probability one (w.p.l), 

n— >oo 

2. lim E[Co„]/n = 7 . 

n— yoo 

Let us now consider some useful inequalities which will be exploited in 
evaluation of the mean cycle time in the next section. In what follows, we 
assume £1, ... ,£„ to be independent r.v.'s. 

We start with a classical result from [12], providing an upper bound on 
the mean value of the maximum of cumulative sums 

Cfe = 6 + • • • + & 

of independent r.v.'s with zero means. 

Lemma 2. If E[£&] = 0, and E|^| p < 00 for some p > 1, k = l,...,n, 
then it holds 



E 
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The next inequality has been derived in |13J . Note that it actually re- 
mains valid under somewhat weaker conditions than that of independence 
between the r.v.'s £1, . . . , £„. 

Lemma 3. If E[^] = 0, and E|^| p < oo for some p, 1 < p < 2 , k = 
1, . . . , n, then it holds 



tiers 2 



7 k=l 



With Lemmas [2] and [3l one can prove the following statement. 
Lemma 4. If E[£fc] = 0, and E[£|] < oo, k = 1, ... ,n, then it holds 

' n \ V 2 

£E[£f] • 



max Cfc 

Kfc<n 



< 2 



2(2n - 1) 



n 



\k=l 



Proof. First note that 



E 















max Ck 

l<k<n 


< E 


max |Cfc| 

l<fc<n 


4 


max |Cfc| 

l<fc<n 
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By applying Lemma [2] with p = 2, and then Lemma we get 

n 2 



E 



max |Cfc| 

KJfc<n 



<8E[C^]<8(2-I)^E[C 



Finally extracting square root leads us to the desired result. 



□ 



Now suppose that £i, present independent and identically dis- 

tributed (i.i.d.) r.v.'s. With this condition, in particular, the inequality in 
Lemma H]takes the form 



E 



max ( k 

Kk<n 



<2J2(2n -1)E[#]. 



The next result obtained in [SI [TO] offers an upper bound for the expected 
value of maximum of i.i.d. r.v.'s. 

Lemma 5. If E[£i] < oo and D[£i] < oo, then it holds 

n — 1 



E 



max Ck 

Kk<n 



< E[£i] + 



i • 



V2n- 1 

Assuming £i,... ,£ n to be i.i.d. r.v.'s, let us introduce the notation 

Qk = 6 + 6+i H 1- 6; 

with 1 < / < A; < n, and consider the following statement. 
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Lemma 6. If E[£i] = a < 0, and D[£i] < oo, i/ien zf /io/ds 



E 



max Ofc 

KKfc<n 



< E[6] + (4V2(2n - 1) + ^==) VmT]. 



Proof. Simple algebraic manipulations give 

( k l-l 

i 

Kl<k<n KKKn 



< 



max Cik = max < > & + > (— &) > 
~ U=l i=l J 

i - °) + Ek< + a ) + 6 i 

KKKn ' — ' — 

~ U=l i=l ) 

k k 
< max > (fi — a) + max > + a) + max ft. 

Kk<n^ \<k<n^ Kk<n 
i=\ i=l ~ ~ 

Proceeding to expectation, with E(£i — a) 2 = , we have from Lem- 
mas S] and [5] 



E 



max C/fe 

KKKn 



n — 1 



< 4^2(2™ - 1)D[6] + E[6] + -/=— Vmi] 

y2n — 1 

= E[6] + (4V2(2n-l) + J^y ) V^T- □ 

4 Exact Evaluation of the Mean Cycle Time 

We are now in a position to prove our main result which can be formulated 
as follows. 

Theorem 7. Suppose that {rj n | n = 1, 2, . . .} , i = 0, 1, . . . , M, are mutually 
independent sequences of i.i.d. r.v. 's with < E[th] < oo. 

Then the limit at ^ exists w.p.l, and if D[rji] < oo, it is given by 

7 = max E[tji]. (3) 

0<i<M 

Proof. First, we have to verify the existence of the limit at ([2]). In order to 
apply Theorem [IJ let us denote 



Q n = max 

l<ki<---<kM<n 



ki £,'2 n 

j=l+l j=ki 3= k M 



for each l,n, < I < n, and note that we can now write 

D M (n) = Con- 
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With simple algebraic manipulations, it is not difficult to verify that the 
family {(i n \ I < n} defined by (|3J) is subadditive. Since th, r^, • • • , are i.i.d. 
r.v.'s for each i = 0,1,..., M, the family also possesses the stationarity 
property. Finally, boundedness follows from the condition < E[th] < oo 
which immediately results in E[£on] = E[I?a./( ?7 -)] > 0. 

Therefore, one can apply Theorem [1] so as to conclude that the limit at 
([2]) exists w.p.l, and it can be calculated as 

7 = lim -E[D M {n)]. 

Suppose that the maximum at ([3]) is achieved at some i = m. Consider 
the completion time -Djy/( n ) an d represent it in the form 

{ki k2 n | n 

E 7 ^ + E r y + • • • + E ™i \ = E r ™i+^ 
j=l j=k-i j=k M ) j=l 

where 



/i = max 

l<fcl<— <&jVf <n 



fel 

E( T 0i ~ T mj) 
3=1 

k2 n 

+ E ( ti j ~ Tm ^ _| — + E ( tm 3 ~ Tm ^ 

3=ki j=k M 
+ T m ki H h Tmfc M |- (5) 

Now we can write 

-E[D M (n)] = E[T ml ] + -E[fj]. 
n n 

Let us examine the expected value E[fj] . With k\ = ■ ■ ■ = k m = 1, and 
km+i = ■ ■ ■ = kM = n, we have from © 

M > Toi +Tii H h rm-1,1 + T m+ i, n H + TMn > 0, 

and so E[//] > 0. 

On the other hand, simple algebra gives us an obvious upper bound for 
fj, in the form 



fei 



fe 2 

+ 1 ^ , m ^? ^ E ( r y ~ + ■ ■ ■ + 1 ?t™> E (™ j ~ Tm 3 • 

l<fci<fe2<n — ' K«jk<h — 

j=fei " i=fejw 

+ Mmax(r m i, . . . ,r mn ) . 
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With the condition that E(rji — T m i) < for all i = 0, 1, . . . , M , one can 
apply Lemma [6] to the first M + 1 terms on the right-hand side, and then 
Lemma [5] to the last one so as to get 



^ £ ( E ( Til - Tml ) + (^V2(2n - 1) + ^7==) V^(rii - r ml )^) 

+ M \E[r ml ] + JLll- y/B[T ml ]j 
= £ E[ra] +(4^2(2^1) + -^=)^^ 

i" — n v V / „■ — n 



1=0 v v / i=0 

n — 1 



+ M - v/PfrVnl], 

\/2n — 1 



and therefore, 

M 



i=0 

Finally, we have the double inequality 

E[r ml ] < -E[D M (n)] < E[r ml ] + -V E[r a ] + 

i=0 

and with n — > oo , immediately arrive at © . □ 

Corollary 8. Under the same conditions as in Theorem^ if at least one 
of the expectations Efr^i] , i = 0, 1, . . . , M , is positive, then it holds 

n = I max EpTjil 

\0<i<M 

5 Tandem Queues with Finite Buffers 

In this section, we show how the above approach can be applied to the 
analysis of tandem systems which include queues with finite buffers. Because 
of limited buffer capacity, servers in the systems may be blocked according 
to one of the blocking rules |14j . Below we present examples of systems 
with manufacturing blocking and communication blocking which are most 
commonly encountered in practice. 

Let us consider a system which consists of two queues in tandem. Sup- 
pose that the buffer at the first server is infinite, while that at the second 
server is finite. The customers arriving to the system have to pass through 
the queues consecutively, and then leave the system. 
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First we suppose that the system operates under the manufacturing 
blocking rule. With this type of blocking, if upon completion of a service, 
the first server sees the buffer of the second one is full, it cannot be freed 
and has to remain busy until the second server completes its current service 
to provide a free space in its buffer. 

For simplicity, let us assume the finite buffer to have capacity 0. With 
the notations introduced above, one can represent the dynamics of the sys- 
tem by the equations 

D (n) = D (n - 1) + r „, 

-Di(n) = max(max(D (n), Di(n - 1)) + Ti n , D 2 (n - 1)), (6) 
D 2 (n) = max(D 1 (n),D 2 (n - 1)) + r 2n , 

for all n = 1, 2, . . . . 

Note that from the second equation, we have D\(n) > D 2 (n — 1), and 
therefore, the third equation can be reduced to 

D 2 (n) = D 1 {n) + r 2n . 

Clearly, under appropriate conditions, both E[Di(n)]/n and E[D 2 (n)]/n 
have a common limit 7 as n tends to 00, which can be considered as the 
mean cycle time of the system. 

By resolving the recursive equations, we get 

{k n-X 
^ toj + T\k + ^2 max(ri J+ i, T 2j ) 
j=l j=k 

As it is easy to verify, Di(n) satisfies the double inequality 

L(n) - max(ri )T1+ i,T2n) < Di{n) < U(n), (7) 

where 

k n 



L(n) = max I ^ r 0j + max(n J+1 ,T 2j ) 
j=i j=k 

k n 

U(n) = max ^ ^ r 0j + ^ max(ri i , T 2 ,j-i) 

i=l j=k 



Kk<n 



Taking into account that both L(n) and U(n) actually have the form of 
(HJ, one can see that, under the same conditions as in Theorem [TJ it holds 

lim —E[L(n)]= lim — E[[7(n)] = max(E[roi], Emaxfru, t 2 \)). 

n— >oo n n— >oo n 
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Finally, proceeding to mean value in both sides of ([7]), divided by n, we 
conclude that the mean cycle time is given by 



Let us now assume the system to follow the communication blocking 
rule. This type of blocking requires the first server not to initiate service of 
a customer if the buffer of the second server is completed. With the finite 
buffer having capacity 0, the system dynamics is described by the same 
recursions as above, except for equation ([6]) which now takes the form 

Di(n) = max(D (n),Di(n - l),D 2 (n - 1)) + T ln . 

Resolving the recursive equations leads us to the expression 



Under the same conditions as in Theorem [71 we get the mean cycle time 



6 Concluding Remarks 

First note that with similar arguments as used in the proof of Theorem [7J and 
related lemmas, one can verify that the statement of the theorem remains 
valid with the condition E[r^] < oo for some a > 1, instead of D[Tji] < oo. 

Furthermore, the proof of the theorem does not actually require that for 
each n, r.v.'s Tj ra with i = 0,1,..., M, be independent. This allows one 
to apply obtained results to tandem queueing systems with dependence for 
each customer between his interarrival and service times, including tandem 
queues with identical service times at each server. 

Theorem [T] actually offers more general existence conditions for the mean 
cycle time, which imply stationarity of the sequence {(ro n , ri n , . . . TMn)\ n = 
1, 2, . . .} in place of independence conditions in Theorem [7J 

Let us consider recursive equations describing the dynamics of the tan- 
dem queues above, and note that the symbol Tj n can be thought of as the 
n th service time at server i rather than the service time of the n th customer 
at the server. Since in this case, the order in which customers are selected 
from a queue for service is of no concern, the equation also describes the 
dynamics of systems with any queueing disciplines not permitting the pre- 
empting of service, and therefore, Theorem [7] can trivially be extended to 
such systems. 

Finally note that the proof of the theorem provides us with bounds on 
E[£>Af( re )]> as well as an upper bound of order n~ 1 / 2 for the convergence 
rate of E[L>j\,/(n)]/n to the mean cycle time as n tends to oo. 



7 = max(E[r i], Emax(rn,r 2 i)). 




7 = max(E[r i], E[m] + E[r 2 i]). 



10 



References 

[1] L. Kleinrock, Queueing Systems, Volume II: Computer Applications. 
Wiley, New York, 1976. 

[2] R. L. Disney and D. Konig, "Queueing networks: a survey of their 
random processes," SIAM Rev. 27 no. 3, (1985) 335-403. 

[3] J. Sacks, "Ergodocity of queues in series," Ann. Math. Stat. 31 no. 3, 
(1960) 579-588. 

[4] R. M. Loynes, "The stability of a queue with non-independent 
inter-arrival and service times," 

Math. Proc. Cambridge Philos. Soc. 58 (1962) 497-520[ 

nttp : // j ournals . C ambridge . org/article_S030500410 0036781 

[5] F. Baccelli and P. Konstantopoulos, 

"Estimates of cycle times in stochastic petri nets," in Applied 
Stochastic Analysis, I. Karatzas and D. Ocone, eds., vol. 177 of 
Lecture Notes in Control and Information Sciences, pp. 1-20. 
Springer, Berlin, Heidelberg, 1992. 

[6] P. Glasserman and D. D. Yao, "Stochastic vector difference equations 
with stationary coefficients," J. Appl. Probab. 32 no. 4, (1995) 
851-866. 

[7] N. K. Krivulin, "Bounds on mean cycle time in acyclic fork-join 
queueing networks," in Proc. Intern. Workshop on Discrete Event 
Systems WODES'98, A. Giua, R. Smedinga, and M. Spathopoulos, 
eds., pp. 469-474. IEE, London, 1998. larXiv: 1212. 1521 [math . DC] [ 

[8] N. K. Krivulin, "Monotonicity properties and simple bounds on the 
mean cycle time in acyclic fork-join queueing networks," in Recent 
Advances in Information Science and Technology, N. E. Mastorakis, 
ed., pp. 146-152. World Scientific, Singapore, 1998. 

[9] E. J. Gumbel, "The maxima of the mean largest value and of the 
range," Ann. Math. Stat. 25 no. 1, (1954) 76-84. 

[10] H. O. Hartley and H. A. David, "Universal bounds for mean range 
and extreme observation," Ann. Math. Stat. 25 no. 1, (1954) 85-99. 

[11] J. F. C. Kingman, "Subadditive ergodic theory," Ann. Probab. 1 
no. 6, (1973) 883-899. 

[12] J. Marcinkiewicz and A. Zygmund, "Sur les fonctions independantes," 
Fund. Math. 29 no. 1, (1937) 60-90. 



11 



[13] B. von Bahr and C.-G. Esseen, "Inequalities for the rth absolute 

moment of a sum of random variables, 1 < r < 2," Ann. Math. Stat. 
36 no. 1, (1965) 299-303. 

[14] N. K. Krivulin, "A max-algebra approach to modeling and simulation 
of tandem queueing systems," 
\Math. Comput. Modelling 22 no. 3, (1995) 25-37 
larXiv: 1211758 11 [mat h . NA] \ 



12 



